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CHAPTER  I 

INTRODUCTION  /B  ACKGROUN  D 


1-1.  INTRODUCTION 

Under  ARI  sponsorship.  HSR  is  completing  a  two-phase  research  study,  the  objectives  of 
which  is  to  provide  guidance  and  means  for  improving  ARTI  P  exerases  lor  maneuver  umts. 
Pus  volume  is  one  of  six  reports  resulting  from  the  study  The  purpose  of  this  volume  is  to 
better  define  and  explore  issues  involved  in  the  integration  of  engagement  simulation  into 
the  Anns  s  program  lor  unit  held  training 

This  report  discusses  in  order 

•  Development  of  conventional  and  engagement  simulation  approaches 
to  unit  training 

•  Steps  in  unit  performance  evaluation  as  conducted  hv  conventional 
methods  and  by  engagement  simulation 

•  Issues  that  need  to  be  resolved  in  contemplation  of  inclusion  of  ES  into 
ARTI  P 

Since  engagement  simulation  methods  are  still  under  development,  this  report  is  intended 
for  the  research  community  and  Army  organizations  responsible  for  collective  training  methods 

1-2  BACKGROUND  OF  ARTEP 

In  I^T .  the  Army  started  to  develop  a  family  of  training  matenals  referred  to  as  Army 
Training  and  I  valuation  Programs  (ARTF.Ps).  The  objective  was  to  address  needs  for  collec¬ 
tive  training  in  a  peacetime  environment  The  ARTFP  concepts  may  be  thought  of  as  broad 
umbrellas  that  can  incorporate  a  variety  of  training  concepts,  methods,  and  techniques  These 
concepts  and  techniques  take  specific  form  in  ARTEP  documents  which  provide  some  five 
chapters  of  general  instructions  followed  by  Training  and  Evaluation  Outlines  (TAEOs). 
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This  current  two-phase  studs  is  concerned  with  Army  guidance  for  Mechanized  Infantry 
units  which  provides  general  instructions  and  T&EOs  for  maneuver  elements  lor  squads, 
platoons,  companies  and  battalions  Guidance  materials  draw  heavily  from  Instructional 
System  Development  and  Skill  Qualification  Tests  prepared  lor  training  individuals  in  MOS 
skills  This  is  reflected  in  the  format  of  then  I  raining  jikI  Evaluation  Outlines  (T&hOs) 

Each  l&l  O  module  specifics  training  objectives,  the  conditions  under  which  the  mission 
is  performed,  and  the  primary  training/evaluation  standards  upon  which  the  element  will  be 
evaluated  (Suggested  support  requirements,  i  e  .  evaluator  personnel,  ammunition,  aggressors, 
maneuver  area,  etc  ,  are  also  identified  In  field  exercises,  trainers  and  or  evaluators  use  the 
l&l  (X  to  either  identity  areas  of  training  needs  or  to  more  formally  evaluate  performance 
When  the  I A I  (X  are  used  in  an  evaluation  context,  actions  covered  by  individual  items  are 
evaluated  by  evaluators  as  satislai  tors  or  unsatisfactory  A  global  assessment  is  then  made 
of  mission  performance  In  a  training  environment,  the  T&l*Os  can  serve  as  a  tool  to  aid  the 
trainer  in  making  diagnostic  decisions  concerning  remedial  training  to  remove  performance 
weaknesses 

1-3  BACKGROUND  OE  ENGAGEMENT  SIMULATION 

ARI  and  private  sector  contractors  have,  under  IKCIXK  sponsorship,  been  developing 
an  approach  to  collective  training  which  is  called  engagement  simulation  Engagement  simu¬ 
lation  is  a  training  concept  guided  by  the  assumption  that  a  realistic  simulation  of  the  battle 
or  or  engagement  provides  best  conditions  for  learning 

1  ngagcmt/it  simulation  fields  opposing  forces  with  conflicting  missions  in  field  exercises 
that  incorporate  free-play  on  the  part  of  one  or  both  of  the  forces  Judgments  of  tactical 
proficiency  are  made  in  terms  of  ground  taken  held,  casualties  inflictcd/suffcred.  and/or 
delay  caused  or  experienced  The  realistic  simulation  of  the  tactical  environment  is  achieved 
through  weapons  signature  rues,  similar  to  what  would  be  encountered  in  actual  combat, 
through  near  real-time  obicctivc  casualty/damagc  assessment  and  through  free-play.  where 
the  engagement  outcome  is  a  direct  function  of  opposing  forces  during  the  exercise 
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In  its  evolution,  engagement  simulation  has  taken  three  forms  SCOPI  S,  Rl  ALIKAIN, 
and  MI1I  S  The  method  originated  with  SCOPLS  (Squad  Combat  Operations  I  xercise,  Simu¬ 
lated  t,  which  was  an  earls  version  lor  infantry  squad  training  When  expanded  tor  combined 
arms  tactical  collective  training,  the  approach  became  known  as  R|- ALIKAIN  In  both 
SCOPLS  and  R1  ALI  RAIN,  damage  casualty  assessment  is  performed  man  will  \  by  a  system 
ot  muneuirr  controller s  Rl  AL 1  RAIN  has  been  successfully  applied  to  cavalry  and  com¬ 
bined  arms  units  of  platoon  and  company  (minus)  size  With  the  introduction  of  laser  equip¬ 
ment.  damage  casualty  assessment  became  more  automatic .  and  the  approach  became  known 
as  MILLS.  an  acronym  lor  Multiple  Integrated  Laser  I  ngagement  System  As  the  engage¬ 
ment  simulation  method  was  evolved,  it  has  been  adapted  for  the  training  of  larger  units 
It  is  believed  that  Mil  I  S  will  permit  training  of  units  as  large  as  battalions 

I  ngagement  simulation  training  attempts  to  elicit  the  same  tactical  behaviors  as  would 
occur  in  combat  The  cues  to  which  soldiers  respond  in  the  training  approximate,  as  nearly 
as  possible,  those  to  which  they  would  respond  in  battle  Combat  elements  attempt  to  re¬ 
spond  in  a  manner  appropriate  to  counter  ami  neutralize  the  effects  ot  the  action  of  their 
adversaries  As  tactical  events  incur .  continual  adiustments  are  made  in  the  tactical  plans 
which  reflect  the  interplay  ot  the  opposing  forces,  and  which  represent  adaptations  to  losses 
of  men.  material,  and  terrain  as  a  result  ot  enemy  actions  Leaders  and  troops  attempt  to 
adapt  their  tactics  to  the  battlefield  situation  ot  the  moment 


CHAPTER  2 

EVALUATION  PROCESSES 

2-1.  THE  BASIC  EVALUATION  PROCESS 

Evaluation  ot  performance  is  an  integral  and  essential  part  of  unit  training  and  mainte¬ 
nance  ol  readiness  Evaluation,  as  defined  in  the  unit  training  context,  can  encompass  activ¬ 
ities  best  described  as  assessments  that  are  made  of  a  unit  while  undergoing  training  Such 
assessments  are  mternallv  generated  and  conducted  Evaluation  can  also  pertain  to  external 
evaluations,  sponsored  by  the  next  higher  echelon 

Current  Arms  practice  uses  both  types  of  evaluations,  both  are  needed  In  the  recent 
past  the  external  evaluation  has  been  a  vehicle  tor  accountability  *  •  *  Current  IORSCOM 
guidance  to  av.  live  components  i  FORSCC )M  Regulation  350- 1 .  9  January  1979 )  states  that 
though  external  (and  internal!  evaluations  can  contribute  to  the  Unit  Status  Report,  the 
primary  aim  ot  the  external  evaluation  is  the  diagnosis  of  the  unit's  training  proficiency 
early  in  a  commander's  tour  in  order  to  facilitate  the  use  of  the  feedback  in  developing 
a  training  program  l  nder  tins  guidance,  the  commanders  arc  not  required  to  assign  ratings 
ot  satist.K  tors  unsatisfactory  upon  completion  of  external  ( or  internal  I  evaluations  or  re¬ 
port  results  to  Headquarters.  IORSCOM 

VOiere  the  external  evaluations  may  occur  infrequently  (eg.  once  every  18  months), 
the  internal  evaluation  is  viewed  by  IORSCOM  i  Regulation  350-1 .  9  January  1979)  and 
by  IR  MMX  (TR.AIXX  Regulation  3 1 0-2.  Draft.  May  1978) as  a  continuous  process  by 
the  trainers  within  the  unit  It  represents  the  day-to-day  diagnosis  and  remediation  of 
unit  deficient ics 


1  Improved  Armv  Training  and  h  valuation  Program  (ARTh'P)  Melh<\h  for  l 'nit  T valuation 
I olumr  I.  t  x  ecu  t  tie  Summary  Study  Oexign  and  Field  Retearch  ARI  Technical  Report  TR-78- 
\2h  November  |97K 

J 

'Improved  Am n  Training  and  I  valuation  Program  IARTTPI  Method*  for  ('nit  l  valuation 
l  olumr  II.  Analvux  ARI  Technical  Report  TR-78  A-26  November  1978 
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Regardless  ot  the  sponsor  internal  or  external  the  process  ol  assessment  should  he 
very  similar  In  this  report  we  will  treat  them  as  equivalent 

rhe  traditional  approach  to  unit  evaluation  is  guided  h>  mission  I&l-Ov  engagement 
simulation  provides  a  different  approach  Regardless  ot  the  approach,  certain  steps  are 
always  involved  in  the  evaluation  process  In  any  evaluation,  there  is  a  performing  unit 
and  a  set  ol  evaluators  During  the  evaluation  process,  the  activities  ot  the  evaluated  unit 
and  those  ol  evaluators  are  interwoven  as  follows 

a  Scenario  Construction  Prior  to  conduct  of  an  evaluation  training  managers 
specify  a  mission  or  missions,  select  ground,  designate  and  construct  a  situation  which  will 
bring  the  unit  m  training  against  an  opposing  torce  in  a  simulated  battle,  and  provide  (or 
be  prepared  to  provide  I  orders  tor  the  leader  ot  the  unit  to  be  evaluated  The  ground  the 
OPIOR.  the  unit  mission! s),  and  orders  to  coordination  make  up  the  scenario  The 
scenario  is  designed  to  provide  units  an  opportunity  to  exercise  combat-relevant  tasks 

b  Tasks  Described  by  Doctrine  There  are  tasks  the  unit  is  to  perform  in  order  to 
accomplish  its  mission,  and  guiding  concepts  as  to  how  these  tasks  should  be  performed.  I  ac¬ 
tual  doctrine  provides  the  guidance  as  to  what  concepts  are  appropriate,  and  as  to  how  they 
should  be  implemented  These  concepts  are  translated  into  criteria  Criteria  may  refer  to 
products  of  an  activity  or  task  to  the  processes  that  units  should  follow  in  order  to  attain 
desired  goals  Criteria  are  used  by  evaluators  and  or  participants  to  evaluate  performance 

c.  Classification  of  Tasks  Within  the  defined  mission  scenarios  monitored  by  evaluators, 
tasks  are  performed  by  members  of  tactical  units  These  tasks  may  be  classified  in  a  variety  of 
ways 

( I  I  Mission  phase  chronology  Unit  missions  may  be  subdivided  into  a  planning 
and  an  execution  phase,  they  may  be  further  broken  out  into  convenient  segments  or  phases 
that  occi  mnng  performance  of  a  mission. 

(2)  Task  Content  The  content  of  tasks  to  be  performed  may  be  classified  in  a 
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variety  of  ways 


ta )  Holistic  01  spec i tic  The  holistic  perspective  views  performance  ot 
the  unit  as  a  whole  from  without  A  specific  or  instrumental  perspective  would  he  son 
cerned  with  actions  ot  specific  unit  elements 

(hi  Internal  coordination  and  support  irr.vwv  enemy  referenced  Another 
system  ot  i lassitK ation  would  subdivide  tasks  into  tasks  ot  communication,  tasks  ot  sup¬ 
port.  and  enenn  relerenced  tasks  Iasks  ot  communications  involve  the  issue  and  dissemina¬ 
tion  ot  orders,  the  reporting  ot  intelligence  and  tasks  ot  lateral  coordination  Support  tasks 
involve  providing  logistical  support,  casualty  evacuation,  replacement  ot  casualties,  etc  A 
third  set  ot  tasks  draws  attention  to  actions  taken  in  contact  with  an  enenn  torce  essential¬ 
ly,  the  interactions  between  antagonists  I  amilies  ot  enenn  -relerenced  tasks  include 

•  finding  the  enemy  force  and  estimating  its  character  si/e 
and  disposition 

•  I  ngaging  the  enemy  force  with  weapons 

•  Avoiding  enemy  observation  tire 

•  Maneuver  to  include  execution  ot  ovcrwatch 

d  Observation  of  Performance.  Three  next  steps  involve  observation  of  performance, 
maintenance  of  a  record  or  trace  ot  performance,  and  evaluating  performance  observed.  These 
steps  are  separable  in  concept  Depending,  however,  on  the  method  of  conducting  exercises, 
these  steps  may  be  conducted  separately  or  combined  We  consider  the  first  two  together, 
then  the  evaluation  of  performance. 

r  Observation  Recording  The  performance  of  the  unit  i.c  .  the  proc  ess  or  the 
product  ot  that  performance,  or  both  are  observed.  A  trace  of  what  occurred  a  history  is 
recorded  either  by  evaluators  or  equipment  It  is  desirable  that  this  record  be  preserved  for 
further  reference,  otherwise,  evaluation  is  entirely  dependent  on  human  memory .  Not  only 
is  human  memory  fallible,  but  later  events  tend  to  be  remembered  better,  so  that  significant 
events  that  occurred  earlier  are  forgotten  or  distorted.  Nonetheless,  the  memory  of  evaluators 
is  always  important  As  discussed  later,  the  memory  of  players  or  trainees  can  serve  as  valu¬ 
able  aids  as  well 

q 


f.  (valuation  Ilu-  performance  that  was  observed  is  compared  with  performance  as  it 
should  have  been  as  specified  by  doctrine,  or.  if  product  criteria  are  invoked,  the  product  of  the 
foregoing  process  is  compared  with  the  desired  product  or  mission  orders  In  either  vase,  doc¬ 
trine  provides,  in  effect,  the  templates  that  guide  comparisons  Plicse  comparisons  indicate  the 
discrepancies  between  performance  as  observed,  and  doctnnally -approved  performance  ll  the 
discrepancy  is  null,  performance  was  effective  Typically  ,  there  are  certain  discrepancies,  and 
these  are  detailed  They  may  be  identified  both  within  the  time  progression  ot  events  within 
the  mission,  and  with  regard  to  contents  categories  mentioned  above 

g  Feedback  and  live  of  Results  I  ecdback  is  the  communication  ot  observed  differences 
between  actions  observed  and  actions  as  they  should  have  occurred  feedback  may  be  delivered 
either  verballv  >r  documented  It  can  be  used  as  a  short  term  assessment  within  a  training  pro 
gram  or  training  exercise  It  van  be  addressed  to  exercise  participants,  to  include  leaders,  to 
trainers  or  to  training  managers  It  van  be  spcctlic  or  general  It  can  provide  overall  assessments 
ol  proficiency  or  ot  progress  in  long-term  training  programs  feedback  can  contribute  to  both 
short  term  and  long-term  planning  ot  training 

2-2  I  S  AM)  CX)NVfNTIONAL  (  OMPARI  O 

The  six  points  described  above  outline  a  general  framework  for  evaluation  of  tactual 
units  Dus  frame  van  provide  a  means  for  comparison  of  engagement  simulation  with  con¬ 
ventional  methods  of  unit  evaluation  By  comparing  the  two  methods  in  terms  of  **-  frame, 
differences  between  conventional  and  I  S  methods  of  evaluation  become  apparent  Identifi¬ 
cation  of  these  differences  helps  define  basic  issues  that  must  be  resolved  in  integration  of 
I  Sinto  ART!  I' 

a  Scenario  Construction  and  f  xcrciv  Structure 

( I  »  I  ngagement  simulation  In  I  S.  scenarios  arc  t\  pic  ally  specified  for  both  forces 
in  a  paired  missions  context .  meeting  engagements,  attav  k-dcfcnsc.  etc  However,  scenarios 
serve  only  as  points  of  departure  for  the  rest  of  the  exercise  I  xcrcise  outcome  is  not  pre¬ 
determined.  ()ncc  the  battle  is  joined,  activities  of  units  arc  dependent  on  actions  and  counter- 


dependent  upon  the  actual  performance  o(  the  opposing  forces  in  critical  behaviors  that 
e merjt  as  a  result  ot  free-play  between  sides 

t2»  I&l  Outline  lorinat  In  conventional  exercises,  the  scenario  is  used  as  a 
stimulus  situation  tor  the  performing  unit  It  is  also  a  control  framework  tor  the  exercise 
Sequences  of  tactical  events  and  Ol’l  OK  behavior  arc  specific,  controlled  and  linked  closely 
to  the  sequences  portray  ed  in  the  mission  being  evaluated  Missions,  tasks  and  conditions 
ot  their  performance  are  in  cflcct  predetermined  Within  this  controlled  environment,  there 
appears  to  be  a  limited  set  of  behaviors  which  can  he  exhibited  by  the  performing  unit  In 
this  sense  the  outcome  of  the  exercise  is  predetermined 

h  I  ask  Content  and  Performance 

<  I »  I  ngjgemcnl  simulation  <  ritual  mission  tasks  and  the  conditions  under 
which  they  are  accomplished  emerge  from  the  free-play  of  the  opposing  forces  Taking 
and  inflicting  casualties  aic  critical  behaviors  (  asualtirs  serve  as  anchor  points  to  identify 
and  examine  critical  activities  behaviors  ot  units  that  led  to  casualties  taken  or  inflicted 
lit  us.  critical  behaviors  are  not  predetermined  but  depend  on  the  progress  ot  the  battle 
I  urthcr.  replays  ot  the  same  scenarios,  missions,  and  performing  units  can  produce  dif¬ 
ferent  critical  behaviors  tor  each  exercise  Participants  are  typically  well-motivated  and 
eager 

(2)  TAl  Outline  formal  f'ntrcal  mission  tasks,  the  conditions  under  which 
they  are  accomplished  and  standards  defining  acceptable  performance  lor  each  task  are 
prcestablished  and  ordered  Hie  exercise  is  structured  to  insure  that  these  tasks  are  per¬ 
formed  One  kev  evaluator  controller  dutv  is  to  sec  that  the  stimulus  orders.  OPf  OK 
play  was  presented  as  planned 

c.  Observation  and  Control  of  Performance 

III  I  ngagement  simulation  It  is  worth  noting  that  engagement  simulation  uses 
■ntrollrrs  rather  than  observer  evaluators  The  duties  of  controllers  varv  considerably  as 
between  Kl  M  I  K  UN  and  Mil  I  S  In  Kl  Al  TRAIN,  precedence  is  given  to  controllers 
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fastening  the  link  as  rapidly  us  possible  between  liters  and  tarsi'  Hus  is  done  b>  confirming 
that  the  target  is  in  the  hirers  sights  and  once  the  round  is  fired,  communicating  this  information 
to  the  controller  on  the  target  selucle  ( This  requirement  is  handled  almost  automatic all>  in 
Mil  I  S.)  A  controller  may  he  encouraged  also  to  make  notes  as  well  about  the  positions  and 
activities  ol  filers  targets  which  proceeded  the  encounter  With  either  RT  ALTRA1N  or  Mll.l  S, 
information  as  to  filers  victims  is  relayed  to  a  net  control  station  which  lop.  casualties  and 
times  Basically  .  the  controller  is  not  regarded  as  an  evaluator  His  comments  on  circum¬ 
stances  relative  to  his  clement  inflicting  suffering  casualties  mas  be  solicited  before  the  After- 
Action  Review-  t  AAR)  to  complete  the  record  The  assumption  explicit  and  implicit  in  the 
I  S  method  is  that  casualties  are  the  basic  performance  criteria,  and  that  the  key  role  of  con¬ 
trollers  is  to  assure  that  they  are  validly  declared  and  sufficiently  well  documented 

(2)  f&l  Outline  format  TAI  O observers  are  assigned  to  units  as  evaluators  and 
controllers  Their  observations  begin  when  the  scenario  OPORI)  is  delivered  by  the  senior 
controller  Throughout  the  exercise,  they  observe,  record,  and  rate  unit  actions  as  they  hap¬ 
pen  in  the  specified  TAI  O sequence  As  controllers,  they  intervene  where  necessary  to  make 
the  scenario  happen  as  planned  Interventions  are  accomplished  bs  issuing  orders  to  the  evalu¬ 
ated  unit  and  bv  adjusting  the  movements  and  actions  of  the  dedicated  Ol’I'OR  Casualties 
may  be  assessed  to  control  the  performing  unit,  or  to  be  used  as  inputs  to  evaluate  support  ele¬ 
ments  concerned  with  casualty  evacuation 

d  (-valuation  of  Performance 

1 1  )  I  ngagement  simulation  I  S  performance  evaluation  measures  have  an  objec¬ 
tive  base  of  casualties  taken  or  inflicted  as  a  result  of  interactions  between  elements  of  the 
two  sides  locked  in  battle  Casualties  taken  or  inflicted  are  to  serve  as  markers  and  as  criteria 
for  evaluation  of  prior  tactical  behavior.  It  casualties  arc  taken,  there  is  an  inherent  implica¬ 
tion  that  tactical  behavior  was  faulty.  It  is  further  assumed  that  the  performance  of  the  men/ 
errw  that  inflicted  the  casualty  was  correct.  I'nlikr  the  conventional  method  of  evaluation 
performance  assessment  occurs  not  by  an  observer  comparing  performance  with  a  preestab- 
lished  doctrinal  template,  but  through  the  action  anil  counteractions  between  sides.  These 
assessments  by  acts  kill  or  be  killed  may  be  elaborated  on  in  discussions  i  the  AAR 


(2>  141  Outline  formal  In  conventional  exercises.  1 41  Outlines  supply  the  mis¬ 

sion- task  framework  tor  performance  evaluation  Process  behaviors  and  unit  activities  used  m 
the  outlines  serve  as  ,ues  to  evaluators  1  valuators  must  supply  the  entena  from  published 
tactics,  doctrine  and  operational  procedures  in  order  to  render  judgments  The  judgments 
are  stochastically  based  The  evaluator  must  decide  if.  over  many  repetitions,  the  perfor¬ 
mance  observed  would  contribute  to  or  detract  from  successful  mission  performance  Thus, 
performance  evaluation  in  the  conventional  sense  requires  subjective  application  ol  doctrinal 
criteria  and  subjective  inferences  about  probable  mission  outcome  based  on  the  unit  Perlor 
mame  observed 

e  Data  Reduction  Interpretation 

ill  I  n gage i  lent  simulation  lo  prepare  tor  the  After-Action  Review  (AAKi  I  S 
data  reduction  procedures  are  primarily  integrative  At  a  Controller  IVbnefing.  controller 
data  .S  used  to  confirm  data  in  the  N(  S  log  Quickly .  events  in  the  N<  S  log  are  used  to  chro¬ 
nologically  reconstruct  the  battle  Controllers  add  pertinent  observations  The  senior  con¬ 
troller  use's  these  comments  and  the  M  S  log  as  the  AAR  agenda 

t ’(  I A 1  Outline  format  Determination  of  performance  scores  is  done  during 
observation,  when  satisfactory  or  unsatisfactory  ratings  arc  made  Summativc  ratings 
arc  made  on  tasks  where  more  than  one  controller  has  observed  unit  performance  or  where 
a  task  has  been  repeated  and  rated  several  times  Although  explicit  instructions  arc  not  pro¬ 
vided  presumably  ratings  ot  lower  echelon  units  are  summed  to  provide  ratings  for  the  next 
higher  unit  I  valuators  jrr  required  to  infer  from  all  task  ratings  if  the  mission  was  ‘success¬ 
ful  "  Fhis  is  to  be  done  in  the  absence  ot  published  guidance  as  to  how  to  combine  ratings 

f  f  valuation  feedback  Delivers  and  Use 

( 1 1  I  ngagement  simulation  I  S  uses  the  AAR  as  its  primary  feedback  vehicle. 
AARs  stresses  guided  discussion  of  tactical  events  by  participants  In  this  sense,  the  evaluation 
is  accomplished  by  individuals  examining  their  own  performance  and  that  of  others  The  pro¬ 
cess  has  been  referred  to  in  ARI  documents  as  "discovery  learning  ”  Thus,  the  information  is 
provided  at  the  individual  or  squad  crew  level  AARs  results  arc  designed  f  -r  quick  use  in 
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successive  trainin'!  exercises  Pwt-rxrMv  narrative  have  been  used  lot  observations  ol  unitv 
over  a  series  ot  exercises  Use  ol  these  narratives  is  said  to  provide  excellent  insights  into  what 
transpired  during  the  exercise 

(2)  TAI  Outline  lorrnal  Conventional  exercises  provide  two  lornis  ot  feedback, 
the  critique  and  completed  IAIO  mission  ratings  Critiques  are  conducted  b>  evaluators  and 
are  directive  Comments  are  rvlated  to  unit  pertomiance  over  all  observed  tasks  Individual 
performance  is  seldom  mentioned  <  ntiques  provide  short  term  inlormation  to  participants 
and  leader  trainers  1AI  Outline  ratings  can  provide  inlormation  to  trainers  and  training 
managers  that  is  comparable  across  units  and  because  ol  this  well  adapted  to  longer  term 
planning  ot  training 

2-3  SUMMARY 

lYior  sections  have  developed  steps  required  in  any  approach  to  collective  training 
They  then  focused  on  differences  between  engagement  simulation  as  a  methodology  and 
typical  practices  in  conventional  (non-engagement  simulation  I  exercises  in  the  AKH  I’  pro¬ 
gram  It  is  important  that  these  differences  be  rec ogmied .  tor  they  help  to  deline  issues  that 
must  be  resolved  in  the  integration  ol  the  two  approaches  In  the  next  section,  these 
differences  are  consolidated  into  four  main  issues  that  bear  on  conduct  ol  unit  proficiency 
assessments 

•  IVvelopmcnt  ol  an  integrated  svstem  ol  measures  and  criteria 

•  Allocation  of  functions  lor  observation,  nidgment  and  data  collection 

•  iVvelopment  of  data  reduction  analysis  procedures 

•  Development  of  privccdurrs  lor  leedback  formulation  and  results  utilization 

These  issues  arc  quite  similar  to  the  issue  areas  reported  on  in  phase  one  protect  work 
on  conventional  methods  of  unit  training  The  similarities  between  issues  that  bear  on  con¬ 
ducting  effective  conventional  exercises,  and  melding  conventional  and  I  S  exercises,  pm 
point  themes  central  to  all  unit  training 
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ISSl  TSPTKTAIMV.  !C)  Ml  ASl  HI  Ml  NT  CKIIIKIA 

»l  I  NT  ROD!  ITION 

An  I  S  AK  1 1  P  involves  integration  ol  criteria  I  nun  two  approaches  the  con¬ 
ventional  method  and  criterion  measures  as  they  have  evolved  from  research  on  en¬ 
gagement  simulation  I  xplored  below  are  issues  involved  in  assessment  ol  criteria 
drawn  from  the  tw.  methods  and  in  their  integration  into  a  single  criterion  system 

I  he  criterion  system  should  satistv  these  requirements 

•  liken  tofrthc  i  ntena  should  cover  c  omprche  naively  critical  be  has  iors 
and  products  ol  these-  behaviors 

•  <  ntenon  measures  should  h«  v.ilnl 

•  It  must  I'.-  possible  to  identitv  dimensions  of  behaviors  subsumed  under 
criteria 

•  It  should  be  |>ossible  to  des,  nK  the  <  item  to  which  behavior  observed 
departed  from  that  prescribed 

Satistv  i  njr  all  these  conditions  in  unit  evaluation  is  quite  difficult  During  long 
term  combat  mans  different  behaviors  may  and  likely  will,  be  important  at  one 
time  or  another  Many  dimensions  of  tactual  behavior  are  difficult  to  define  and  to 
quantify  I  inallv  .  obtec  for  evaluation  of  performance  becomes  more  difficult  if 
evaluations  must  depend  on  human  observers 

These  difficulties  exist  whether  we  refer  to  the  conventional  system  of  using 
A  K  1 1  P  I  A I  (  H  or  IS.  but  they  ansc  in  different  degrees  in  these  two  criterion 
approaches  In  melding  the  two  approaches,  we  wish  to  look  for  strengths  and  weak¬ 
nesses  of  each  and  how  weaknesses  of  either  approach  mav  be  compler  -nted  by  the 
strengths  of  the  other 


3  2  ADVANTAGES  AND  LIMITATIONS  OE  TAEOS  AS  CRITERIA 


Die  ARTEP  provides  a  framework  of  unit  performance  attributes  by  listing 
unit  behaviors  as  tasks  and  subtasks  for  each  mission  in  the  order  in  which  they 
are  expected  to  occur  I A I  items  as  criteria  are  the  product  of  a  task-analytic 
approach  I'hev  reflect  the  assumption  that,  it  the  behaviors  as  listed  are  satisfac- 
orily  performed  li  e  perlonned  as  specified  b>  doctrine),  on  a  stochastic  basis, 
mission  performance  would  be-  successful  in  combat  Hie  TAE  Outlines  are  pre 
sently  used  as  guidance  tor  conduct  of  unit  training  As  such,  they  offer  a  direc  t 
framework  for  assessment 

This  frame  is  especiall>  useful  in  providing  guides  for  evaluation  of  all  those 
activities  that  typuallv  precede  the  battle  accepting  orders,  reconnaissance,  formu¬ 
lating  mission  plans,  and  issuing  orders 

Once  the  battle  is  joined.  TAI  Outlines  lor  tactical  units,  as  presently  con¬ 
structed  and  used,  have  several  drawbacks  as  measurement  devices  I  irst.  the  pro¬ 
cesses  listed  under  "Standards"  are  simply  cues  to  trainers  and  evaluators  In  many 
instances,  all  relevant  dimensions  of  tasks  are  not  defined,  nor  is  guidance  provided 
as  to  how  tasks  or  attributes  should  be  evaluated  Performance  standards  and.  in 
come  cases,  task  dimensions  must  be  gleaned  from  field  manuals  I  or  example,  one 
element  in  a  I  Al  Outline  lor  movement  to  contact  is  "use  of  bounding  overwatch" 
Descriptions  of  correct  use  of  bounding  overwatch  are  not  listed,  but  must  be  remem¬ 
bered  from  published  guidance  Standards  must  be  subjectively  interpreted  and  applied 
bv  individual  evaluators  f  inally .  the  structure  of  IA1  Outlines  present  mission  per¬ 
formance  steps  m  a  straight  chronological  sequence  During  conduct  of  the  battle,  it 
is  unlikely  that  any  gisen  predetermined  sequence  of  actions  will  be  precisely  appro 
pnatc  Rather,  unit  leaders  and  men  must  draw  from  their  repertoire,  responses  appro¬ 
priate  to  the  demands  of  the  situation  at  the  moment  TAE  Outlines  as  configured  do 
no!  readily  permit  this  flexibility 
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Si  !l  other  problems  with  T&HH  in  their  present  form  are  evident,  although 
these  are  in  format  and.  in  some  eases,  in  lack  of  adequate  instructions,  rather 
than  in  concept 

•  Fhe  present  format  of  T&.1  items  evidently  to  save  space  often  combines 
two  or  more  behavioral  parameters  under  one  item  In  many  items,  these 
parameters  can  be  orthogonal  or  independent  The  evaluator  can  only  mark 
SAT  or  UNSAT.  Space  allocated  lor  marginal  notes  is  minimal  A  training 
manager,  given  completed  IAF  items,  would  not  be  able  to  “recapture  per¬ 
formance  for  each  parameter  This  means  for  formatting  items  is  inimical  to 
incisive  training  diagnosis 

•  Often.  evaluators  are  asked  to  make  global  judgements  of  unit  performance 
without  adequate  guidance  as  to  how  to  make  their  judgements 

•  In  some  cases.  instructions  are  insufficient .  for  example,  items  covering  the 
use  ot  cover  concealment  b>  platoons,  companies,  and  battalion  For  a 
battalion  field  exercise,  is  the  evaluation  of  use  of  cover  concealment  a  sim¬ 
ple  summation  of  use  of  cover  concealment  bv  organic  elements’  If  so.  this 
should  be  stated  in  the  instructions 

The  points  above  should  be  regarded  as  technical  problems  rather  than  as  faults 
of  concept  All  van  be  remedied  Nonetheless,  until  this  is  done,  the  full  potential 
of  TAFOs  cannot  be  exploited  as  a  training  instrument 

3-3  ADVANTAGES  ANI)  UMITS  OF  IS  (  RITFRIA 

If  controllers  are  well  trained  and  if  their  equipment  (or  the  Mil  I  S  system)  is 
working,  a  major  strength  of  engagement  simulation  is  its  objectivity  in  determining 
casualty  and  damage  outcomes  from  conflicts  Further,  when  engagement  outcomes 
arc  linked  to  unit  and  individual  behaviors  in  post-cxcrcixc  critiques,  its  power  as  a 
self  and  peer  assessment  tool  is  compelling 

Fngagernent  simulation  demands  special  equipment  (vopes.anu  radios,  or  laser*  ^ 
sensorsl  in  order  to  more  realistically  play  the  battle  As  such,  it  provides  an  environ 
ment  in  which,  because  of  interactions  between  sides,  unanticipated  events  can  and 


trrqucntly  do  .Kcur.  and  leader,  and  men  must  respond  to  the  situation  at  the  moment 
in  intelligent  and  creative  ways  Hies  cannot  tall  back  on  prescribed  I&l  Outlines  for 
the  right  answer  Its  essential  .ntena  are  histones  ol  casualties  suffered  by  each  side 
through  tune  which  it  produces,  and  the  position  of  the  umttsl  on  conclusion  ot  the 
eser.ise  In  addition,  unit  positions  through  time  .an  be  recorded,  as  can  traffic  on 
tadual  nets  but  such  records  might  be  made  and  might  well  be  desirable  in  conven¬ 
tional  exercises  as  well  Pius,  the  unique  character  ot  engagement  simulations  is  pre¬ 
dicated  on  its  abilits  to  bnng  about  casualties  in  a  timely  manner  as  a  resultant  of 
interactions  between  antagonists  t  I  he  fact  that  casualties  are  sometimes  played  in 
conventional  exercises  does  not  mean  that  the  two  approaches  are  comparable  in  ca.su- 
alts  play  realistic  ally  .  conventional  exercises  la.lc  the  means  to  play  casualties  well  I 

a  Product  and  Pphcvs  In  I  S  casualties  as  proJu.  t  criteria  provide  the  basis 
tor  conduct  ot  the  critique  or  Alter  Action  Review  (AAR),  as  it  is  called  in  engagement 
simulation  When  the  battle  is  over,  the  "lolled'-  are  resurrected,  and  the  history  ot 
casualties  is  reviewed  in  plat.von  level  exercises  with  all  participants  present  I  ach  ca.su- 
alts  becomes  a  "marker"  which  calls  attention  to  the  presumed  effective  behavior  b\ 
the  killer  and  ineffective  behavior  on  the  part  ol  his  victim  Pie  AAR  brings  out  these 
process  behaviors  or  process  ,nttrtj  as  they  boar  on  actions  of  participants  specific  to 
each  mini-engagement  l  urther,  players  and  controllers  participate  Information  from 
all  these  sources  are  combined  in  group  discussions  to  get  the  record  straight  Pius,  as 
utions  emerge  during  the  conflict,  process  criteria  tor  evaluation  of  these  actions  are 
drawn  out  during  the  AAR  Since  criteria  represent  the  integration  ot  inputs  trom 
plavers  and  controllers,  they  are  .1  r .  to  be  more  relevant  and  more  valid  than  the  nil 
mgs  ol  a  single  evaluator  using  pre-formatted  I&l  Outlines 

h  <  asualties  as  C  riteria  l  ngagement  simulation  as  a  training  method  provides 
a  tar  more  realistic  plav  of  the  battle  than  does  the  standard  format  f  asualttes  are  pn» 
duerd  by  the  interactions  between  sides  However,  questions  may  be  raised  with  regard 
to  the  sufficiency  and  (insanant)  validity  of  the  casualties  as  entena  Pi  esc  questions 
apply  in  somewhat  different  form  ...  front  line  elements  and  to  leaders 
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( 1 )  Casualty  Criteria  as  Applied  to  Vehicles  .'Infantry.  The  most  com¬ 
pelling  criterion  lor  battle  success  is  kills  or  casualty  ratios  between  sides  While 
casualty  ratios  have  lace  validity  in  the  gross  sense,  the  occurrence  of  individual 
casualties  cannot  be  taken,  ipso  facto,  as  proof  that  the  casualty  made  a  mistake 
I  or  example,  in  an  attack  mission,  vehicles  inlantry  may  make  best  use  of  dim  table 
cover  and  concealment  but  still  suffer  casualties  Assuming  that,  in  most  instances, 
the  player  or  the  vehicle  that  became  a  casualty  made  a  mistake,  it  is  not  necessarily 
true  that  he  (it)  did  further,  as  casualties  are  not  prool  of  ineffective  performance . 
those  who  made  avoidable  em>rs  arv  not  alwavs  penalized  by  becoming  casualties. 

Men  ot  the  opposing  force  mas  not  be  alert,  or  they  may  not  be  able  to  see  soldiers 
vehicles  that  needlessly  exposed  themselves  In  sum.  casualties  are  not  an  absolute 
indicator  of  effective  or  of  ineffective  perlomiance  of  front-line  elements 

i2i  (  asualtv  C  riteria  as  Applied  to  I  valuation  of  Leader  Performance 
What.  then,  shall  we  sav  about  use  ot  casualties  as  indicators  of  leader  performance  ’ 

Hus  question  becomes  increasingly  pertinent  as  we  go  to  company  and  battalion 
level  I  S  exercises  Here,  casualties  mav  have  occurred  because  of  a  poor  plan,  be 
cause  of  ineffective  execution  of  the  plan,  or  for  both  reasons  What  observations  of 
what  elements  arv  needed  so  that  I aults  in  planning  can  be  separated  from  faulty 
execution'*  Another  question  What  is  the  role  of  casualties  in  evaluation  of  perfor 
mance  of  companies  and  battalions*  Here,  with  many  men  and  vehicles  engaged.  AARs 
cannot  well  review  casualties  on  a  one-bv-onc  basis  How  can  casualties  be  integrated 
and  used  as  measures  of  leader  company  performance'*  These  are  questions  that  remain 
to  be  clearly  answered 

3-4.  INTHiRATION  OF  CRITERIA:  ES  AM)  CONVENTIONAL  METHODS 

I  S  and  conventional  methods  of  evaluation  introduce  philosophically  and  opera¬ 
tionally  different  approaches  to  problems  of  performance  measurement  Questions 
arise  as  to  whether  the  two  can  be  successfully  integrated,  and.  if  so  on  what  basis. 
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Hu-  I  S  method  requires  added  equipment  It  may  be  justified  on  two  bases 

•  It  provides  a  much  more  realistic  better  play  of  the  battle 

•  A  National  Training  C  enter  is  being  planned  Primary  emphasis  is  on  train¬ 
ing  of  maneuver  units  as  organic  battalions  and  perhaps  companies  The 
center  will  play  two-sided  field  exercises  using  the  I  S  format  The  ust-  ol 

I  S  for  home  station  training  could  serve  better  to  prepare  personnel  lor 
training  at  the  NTC 

Wien  the  costs  of  added  equipment  (either  scopes  radios  or  lasers,  sensors  I  and  the  needs 
tor  skills  to  operate  and  maintain  this  equipment  are  considered.  I  S  mnnol  be  used  merel i 
an  aJ/unct  to  the  conventional  method  that  uses  TATOs  as  a  guide  Rather,  conventional 
methods  must  be  built  around  the  I  S  frame  and  format  It  further  follows  that,  to  the  extent 
possible,  training  diagnosis  and  critiques  must  be  built  around,  and  support,  casualty  records 
Tins  raises  at  least  two  issues 

•  How  atmplelc  a  coverage  of  c  ritual  actions  does  a  valid  and  complete  record 
ot  casualties  provide'1  What  supplementary  information  is  needed  for  a  com- 
plete  training  diagnosis’  VSe  can  assume  that  casualties  will  be  reported  to  an 
M'S  It  a  IAI  ()  tv  |x*  format  is  used  to  permit  collection  ot  additional  critr 
non  information,  what  should  its  format  be'  How  specifically  should  it  try 
to  describe  behavioral  parameters’ 

•  What  concepts  shall  be  applied  to  collect  additional  criterion  data1  Wc  can 
assume  that  casualties  will  be  recorded  at  NT'S.  Once  the  supplementary 
information  required  (see  above  issue)  has  been  determined,  it  can  better  be 
determined  what  added  criteria  are  needed  One  possibility,  surely .  is  to  use 
some  format  analogous  to  IAI  Outlines  to  permit  controllers  to  make  eval¬ 
uations  Here,  since  activities  arc  apt  to  deviate  both  in  their  specifics  and 

in  time  from  those  described  in  any  prearranged  outline,  some  flexibility  will 
be  needed  Possibly,  as  an  aid  to  evaluation,  a  more  general  set  of  process 


Thu  became  obvious  in  observations  of  one  battalion  field  exercise  Vehicles  were  numbered 
las  m  RT  Al  TRAIN),  but  there  was  no  net  control  station  (  asualtv  records  were  than  not  available 
for  the  post -exercise  critique 
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criteria  may  he  provided  to  evaluators.  A  broad  classification  of  tasks  such 
as  that  outlined  under  2-1  -c .  Classification  of  Tasks,  might  he  appropnate 
Other  possibilities  include  recording  traffic  on  tactical  nets  at  least  on  a 

sampling  basis  and  maintaining  a  running  record  ol  positions  of  units  and 

4 

their  elements  over  time 


4  The  feasibility  of  relating  such  records  to  criteria  is  being  pursued  in  ongoing  ARI  research 


CHAPTER  4 

ISSUE'S  COVERING  OBSERVATION  CONTROL  SYSTEM  FUNCTIONS 


Criterion  measures  for  the  integrated  system  determine  largely  what  must  be 
done  to  observe  and  record  performance  The  measures  chosen  specify  what  informa¬ 
tion  is  to  be  collected  and  roles  of  observers  evaluators  m  collecting  this  information 
and  or  in  helping  to  collect  data 

However  other  functions  need  to  be  performed  in  addition  to  those  strictly 
related  to  the  observation  and  evaluation  of  performance.  These  include  control, 
rule  enforcement,  satetv  overwatch,  administration  and  hardware  system  operation. 

(  umuiatively .  both  tyi>os  of  lunctions  define  requirements  placed  on  the  observa¬ 
tion  control  in  terms  of  numbers  of  people,  equipment,  skill  and  training,  duties, 
coordination,  and  logistical  support  requirements 

Based  on  field  observations,  functions  to  be  performed  by  controller  evaluators 
are  as  follows 

a  Functions  Required  to  Make  I  S  Work  There  arc  certain  things  controllers 
must  do  iust  to  make  I  S  work  These  functions  differ  between  RI  AL  TRAIN  and 
MIIIS  In  REA1  I  RAIN  controllers  coordinate  to  apply  the  rules  of  engagement  and 
declare  casualties  This  requires  time  and  attention  exactly  when  critical  actions  are 
taking  place  It  needs  to  be  determined  if  I  S  controllers  can  simultaneously  observe, 
rate,  and  record  process-type  behavior  while  accomplishing  their  I  S  functions  The  re¬ 
sult  will  have  implications  tor  both  si/e  and  structure  of  the  controller  force 

b  Functions  Required  for  Performance  Observation  These  activities  bear  on 
the  assignment,  location,  and  movements  of  observers  C  oordination  of  activities  be¬ 
tween  observers  to  keep  tr.uk  of  coordination  between  elements  of  performing  units 
hat  are  not  in  physical  contact  are  of  interest  So  are  activities  such  as  use  of  cover, 
onccalmcnt,  and  selection  of'routcs  for  advance  Requirements  in  observing  these 
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tunc  lions  have  implications  lor  tune  sharing  by  observers  between  functions,  .is  well  as 
the  number  ol  observers  needed 

i  Functions  Required  tor  Performance  I  valuation  A  distinction  is  made  between 
this  category  and  observation  Depending  on  the  measures  chosen,  some  data  may  be  col¬ 
lected  and  analyzed  later  to  determine  proficiency  It  this  is  the  case,  less  skill  and  tr  ng 
is  needed  tor  observers  data  collectors  It  each  observer  must  also  make  judgments  about 
what  he  sees,  then  considerably  more  training  and  skill  will  be  required  Tins  has  implications 
for  the  size,  structure,  skill  and  training  requirements  ol  the  observer  group  Several  things 
need  to  be  determined 

•  !  o  what  extent  can  information  on  certain  measures  be  collected  by  individ¬ 
uals  with  no  s|h.'v lal  training  or  qualifications'’ 

•  Mow  much  can  observer  training  compensate  for  lack  ol  prerequisite  MOS 
or  skills'1 

•  What  measures  must  be  evaluated  as  they  occur’  Which  ones  can  wait’’ 

d  Functions  Required  for  Control  As  previously  mentioned.  I  S  emphasizes  two-sided 
free  play  scenarios  and  allows  situations  to  emerge  In  certain  instances,  this  approach  may 
conflict  with  the  need  to  structure  the  scenario  to  bring  out  prrestablishcd  assessment  require¬ 
ments  Here  de|'cnding  on  evaluation  objectives,  the  scenario,  or  the  action  ol  OPFOR.  or 
both  may  require  more  structure  *  Hus  creates  the  requirement  for  control-type  functions 
not  often  used  in  I  S  It  must  be  d-tcrmincd  how  additional  control  functions  lit  with  the 
other  duties  of  exercise  controllers  and  what  increases  in  ■  ontroller  load  they  cause  To  the 
extent  possible,  procedures  would  need  to  be  developed  so  that  personnel  assigned  as  con¬ 
trollers  could  assume  these  additional  duties  without  becoming  severely  overloaded 


this  is  not  without  pie.edent  even  in  straight  I  S  "training"  situation*  Controllers  mav  require  that 
elements  request  permission  to  fire,  if  there  are  certain  activities  that  the  controller  wails  lo  observe  or  pro¬ 
vide  for  the  performing  unit 
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CHAPTER  5 

ISSUES  Oh  DATA  REDUCTION. 
ANAEYSIS  AND  INTEGRATION 


Procedures  required  to  reduce.  analyze  and  integrate  data  obviously  depend  on  the  nature 
ol  the  data  to  he  collected  rhu».  issues  such  as  those  described  above  need  to  be  resolved  first 
lacking  resolutions  of  these,  we  may  start  with  certain  "givens  I  S  will  provide  casualty 
records  through  time  and  positions  of  opposing  units,  it  desired  It  the  conventional  method 
is  used  to  supplement  I  S  we  on  i  \pe«.t  evaluator  ratings  and  or  observations  Other  informa¬ 
tion  such  as  records  ot  tactual  radio  tra.fic  mav  f'e  collected  as  well  In  any  evaluation  then, 
we  on  salclv  assume  a  substantial  amount  of  data  will  be  collected  I  urther.  this  amount  and 
its  complexity  will  increase  with  unit  si/e 

The  information  from  these  several  '  >ufscs  needs  to  be  consolidated  I  urther.  if  it  is  to 
be  of  most  value  to  units  in  training  s  thev  can  review  details  of  the  engagement  while  it  is 
fresh  on  their  minds  integration  must  ixcur  rapidly  I  mails  .  speed  ot  data  reduction  and 
integration  must  he  balanced  with  the  needs  lor  feedback  specificity  and  comprehensiveness 
\  number  of  questions  then  arise 

•  Mow  shall  the  data  from  the  several  sources  be  combined’  Bv  what  lope’ 

•  (  111  evaluator  ratings  ho  eftectivelv  used  to  better  explain  reasons  lor 
casualties  and  kev  events  that  proceeded  them"’ 

•  (  an  the  same  formula  or  algorithms  for  data  integration  be  used  what 
ever  the  mission  and  in  whatever  way  it  unfolded’ 

•  Are  the  data  information  needed  for  the  AAR  and  by  the  training 
manager  the  siine.  or  do  they  differ’  If  so.  in  what  respects’ 

These  are  among  the  issues  that  need  resolution 
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ISSl'FS  OF  FFFDBACK  AND  RFivl  LTS  HSI 


6-1  ISIRODIHTION 

Post -exercise  feedback  may  bo  provided  l»»  players  and  trainers  as  immediate  knowledge 
ot  results,  to  training  managers  to  help  plan  and  schedule  future  training,  and  to  headquarters 
personnel  who  may  be  concerned  with  strengths  and  weaknesses  of  institutionalized  training 
programs 

Major  differences  between  the  engagement  simulation  approach  to  unit  training  and  Un¬ 
conventional  approach  continue  to  t>c  evident  as  one  considers  development  ol  pcrscnpUvc 
guidance  for  feedback 

6  :  HD  A  I'M  R  AlTION  Kl  VIFW  OK  t  RITIQtl 

Huis  tar  I  S  has  stressed  quick  verbal  feedback  essentially  bflwccn  /’ ld\cr\  ot  the  two 
sides  with  an  AAR  leader  acting  as  "chairman  ot  the  board"  and  using  casualty  histories  as 
agenda  items  An  exercise  narrative  is  sometimes  prepared  lor  trainers  and  training  managers, 
however  this  feature  does  not  appear  to  be  unique  to  engagement  simulation  Such  a  narra¬ 
tive  could  readily  lx-  prepared  from  well-kept  I  AM)  protocols  The  conventional  exercise 
lends  itself  to  a  c  ritique  lormat  typically  with  a  leader  pointing  out  effective  and  ineffective 
behavior  to  participants 

6-.f  USf  OF  AAR 

•Vs  discussed  elsewhere,  the  AAR  appears  to  be  a  much  more  powerful  teaching  device 
than  the  typical  critique  given  after  conventional  exercises  <  asualties  are  confronted  with 
consequences  of  their  behavior  rather  than  rulings  of  evaluators  supported  bs  tactical  con¬ 
siderations  that  may  well  be  stochastic  and  abstract  A  major  issue,  however  should  be 
considered  before  accepting  the  I  S  format  fully  Since  outcome  data  are  so  convincing,  the 
potential  exists  for  outcomes  to  overshadow  orrret  and  incorrect  performances  that  are  not 


directly  related  to  casualties  as  outcomes  Consider  the  following  example.  It  a  unit  fails  to 
use  a  sound  tactical  plan,  but,  by  chance,  surprises  and  defeats  its  adversaries,  it  becomes 
more  difficult  to  illustrate  performance  deficiencies  It  is  important,  then,  when  using  I  S 
techniques  and  AARs  m  unit  assessment,  that  procedures  be  developed  to  put  engagement 
outcomes  in  a  proper  perspective 

A  further  issue,  raised  above,  is  worth  note  Namely  .  the  time  required  to  integrate  data 
obtained  from  the  two  approaches  may  be  such  that  delays  ol  several  hours  would  be  encount¬ 
ered  in  assembly  of  information  which  is  to  be  used  in  the  AAR  Such  delays  m  providing 
feedback  should  be  avoided  if  at  all  possible  in  planning  AARs  for  troops,  delays  are  believed 
to  be  less  harmful  in  planning  AARs  for  leaders 

INFORMATION  TO  TRAINING  MANAGERS 

Hie  I  S  method  provides  information  to  training  managers  as  histones  of  kills  and  an 
exercise  narrative,  the  conventional  I A I  format  provides  information  in  the  form  of  com 
pleted  checklists  Mould  training  managers  prefer  one  form  of  such  information  over  another'* 
Would  they  like  both  ’  Hus  needs  to  be  determined 

•\  further  question  may  be  raised,  namely  Would  training  managers  ever  for  any  purpose, 
wish  to  i  r irnfarr  scores  or  quantitative  data  so  as  to  i< ■mf>ar<'  performance  of  squads,  platoon', 
or  companies'’  Since  I  S  pits  one  unit  against  another  scores  are  r,lati\<  to  the  capabilities  of 
the  two  units  Pic  1AI  (>  format  provides  scores  based  on  a  common  set  of  parameters  Thus 
it  the  SAIN  I  NSATS  from  completed  rating  forms  can  be  regarded  as  of  some  validity  then 
this  formal  permits  cross-unit  comparisons  Pie  I  S  format  only  permits  comparisons  of  scores 
for  the  two  units  engaged 


